Minimum Message Length Shrinkage Estimation
نویسندگان
چکیده
This note considers estimation of the mean of a multivariate Gaussian distribution with known variance within the Minimum Message Length (MML) framework. Interestingly, the resulting MML estimator exactly coincides with the positive-part JamesStein estimator under the choice of an uninformative prior. A new approach for estimating parameters and hyperparameters in general hierarchical Bayes models is also presented.
منابع مشابه
Shrinkage and Denoising by Minimum Message Length
This paper examines orthonormal regression and wavelet denoising within the Minimum Message Length (MML) framework. A criterion for hard thresholding that naturally incorporates parameter shrinkage is derived from a hierarchical Bayes approach. Both parameters and hyperparameters are jointly estimated from the data directly by minimisation of a two-part message length, and the threshold implied...
متن کاملShrinkage Preliminary Test Estimation under a Precautionary Loss Function with Applications on Records and Censored Ddata
Shrinkage preliminary test estimation in exponential distribution under a precautionary loss function is considered. The minimum risk-unbiased estimator is derived and some shrinkage preliminary test estimators are proposed. We apply our results on censored data and records. The relative efficiencies of proposed estimators with respect to the minimum ‎risk-unbiased‎&...
متن کاملMinimum Message Length Inference and Parameter Estimation of Autoregressive and Moving Average Models
This technical report presents a formulation of the parameter estimation and model selection problem for Autoregressive (AR) and Moving Average (MA) models in the Minimum Message Length (MML) framework. In particular, it examines suitable priors for both classes of models, and subsequently derives message length expressions based on the MML87 approximation. Empirical results demonstrate the new...
متن کاملChange-Point Estimation Using New Minimum Message Length Approximations
This paper investigates the coding of change-points in the information-theoretic Minimum Message Length (MML) framework. Changepoint coding regions affect model selection and parameter estimation in problems such as time series segmentation and decision trees. The Minimum Message Length (MML) and Minimum Description Length (MDL78) approaches to change-point problems have been shown to perform w...
متن کاملImproved Estimation in Rayleigh type-II Censored Data under a Bounded Loss Utilizing a Point Guess Value
‎The problem of shrinkage testimation (test-estimation) for the Rayleigh scale‎ ‎parameter θ based on censored samples under the reflected‎ ‎gamma loss function is considered‎. We obtain the minimum risk‎ ‎estimator among a subclass and compute its risk‎. ‎A shrinkage‎ ‎testimator based on acceptance or rejection of a null hypothesis&lr...
متن کامل